ECURITY  CLASSIFICATION  OI^FFIIS  PAGE 


a.  REPORT  SECURITY  CLASSIFICATION^  ;;  :  V  ■ 
Unclassified  rr^, 

2a.  SECURITY  CLASSIFICATION  AUTH^fY  St-P  *< 

:b.  DECLASSIFICATION  1  DOWNGRA^^CHEDUL 


1.  PERFORMING  ORGANIZATION  REPORT  NUMBER* 

ISI  Report  it  5877-01 


6a.  NAME  OF  PERFORMING  ORGANIZATION 
Integrated  Systems  Ire. 


6c  ADDRESS  (C/ty,  State,  and  ZIP  Code) 

2500  Mission  College  Blvd. 
Santa  Clara,  CA  95054-1215 


AD-A227  304 

-oZ***-\  . . . 


Ta.  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 

AFOSR 


8b  OFFICE  SYMBOL 
(If  applicable) 

NA 


8c  ADDRESS  (City,  State,  and  ZIP  Code) 


Bolling  AFB 
Washington,  DC  20332 


1.  TIT'."  (Include  Security  Classification) 

....aptive  Control  of  Large  Space  Structures 


2.  PERSONAL  AUTHOR(S) 

’  obert  L.  Kosut 


.  TYPE  OF  REPORT 
Final  Report 


F  SUPPLEMENTARY  NOTATION 


OF  REPORT 


13b.  TIME  COVERED 

from2-1-89  to3-31-90 


S.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 

AFOSR-TR-  9  o  Q  c;  V  2 


7a  NAME  OF  MONITORING  ORGANIZATION 

IBAF,  Air  Force  Office  of  Scientific  Research 


7b  ADDRESS  (City,  State,  and  ZIP  Code) 
Building  410 

Bolling  AFB,  DC  20332-6448 


9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
F49620-89-C-0043 


10.  SOURCE  OF  FUNDING  NUMBERS 


WORK  UNIT 
ACCESSION  NO 


PROGRAM 

PROJECT 

TASK 

ELEMENT  NO. 

NO. 

NO 

61102F 

2302 

B 1 

14.  DATE  OF  REPORT  (Year.  Month.  Day)  hs.  PAGE  COUNT 
8-15-90  2,1 


COSATI  CODES 


GROUP  SUB-GROUP 


18  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 


9.  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

'  Preliminary  results  are  presented  for  set  estimation  of  uncertain  nonlinear  systems. 
Set  estimation  is  a  process  in  an  adaptive  robust  control  sytem  which  produces  a  set  of 
models  from  the  measured  data.  The  set  is  then  used  in  an  on-line  robust  control  design  to 
implement  a  controller  which  is  guaranteed  to  acheive  performance  goals  for  all  members 
of  the  set.  The  scheme  works  whenever  the  actual  system  which  produced  the  data  is  a 
member  of  the  estimated  set.  The  results  in  this  report  extend  some  previous  work  in 
linear  set  estimation  to  nonlinear  systems.  This  report  also  summarizes  an  alaysis  of  an 
adaptive  nonlinear  system  using  the  method  of  averaging.  _ _ 1  , 

c-  n  1 


integrated 
systems  me. 


u'.uU _ 

ttflual  Technical  Report 
1  Feb  1989  through  31  Jan  1990 


SEOSS-TR-  hi  i 


O'!  ■>  1 


Adaptive  Control 
of 

Large  Space  Structures 


(Contract  No.  F49620-89-C-0043) 


Prepared  by: 

Dr.  Robert  L.  Kosut 


Integrated  Systems  Inc. 
2500  Mission  College  Boulevard 
Santa  Clara,  California  95054-1215 


Prepared  for: 


AFOSR,  Directorate  of  Aerospace  Sciences 
Bolling  Air  Force  Base 
Washington,  DC  20332 


ISI  Report  No.  5877-01 
15  Aug  1990 


Contents 


1  Background  and  Objectives  1 

2  Current  Status  1 

3  Design  of  Adaptive  Control  Systems  3 

4  Linear  Set  Estimation  7 

5  Nonlinear  Set  Estimation  9 

5.. 1  Example  1:  Input  Nonlinearity .  9 

5..  2  Example  2:  Output  Nonlinearity .  10 

5..  3  Example  3:  Mechanical  System .  11 

5.1  Standard  Model  Structure .  14 

5.2  Disturbance  Modeling .  17 

5.3  Nonparametric  Uncertainty .  18 

6  Robust  Control  Design  19 

6.1  Robust  Nonlinear  Control .  19 

6.2  Robust  Linear  Control  of  Nonlinear  Model  Sets .  19 

A  Appendix:  Reprints  of  Technical  Articles  25 


Accc-'.ior.  tor 

NT1S  Cr’A&! 

OTIC  TaB 

U  j-i.'iouncod 
Justific-Jt.or. 

By  . . 

Dist'ib  itio*'  / 
A>->  I 

A 

Dist  Sl 


i 


1  Background  and  Objectives 


The  Large  Space  Structure  (LSS)  research  program  was  originally  formulated  in  late  1982 
in  response  to  the  increasing  concern  that  performance  robustness  of  Air  Force  LSS  type 
systems  would  be  inadequate  to  meet  mission  objectives  principally  because  of  uncertainties 
in  both  system  dynamics  and  disturbance  spectra.  This  lead  to  consideration  of  adaptive 
control  systems,  where  disturbances  and/or  plant  models  are  identified  prior  to  or  during 
control,  thereby  giving  systems  designers  more  options  for  minimizing  the  risk  in  achieving 
performance  objectives. 

In  the  early  ACOSS  and  VCOSS  programs  issues  of  performance  sensitivity,  robust¬ 
ness,  and  achievement  of  very  high  performance  in  an  LSS  system  were  addressed.  These 
programs  established  the  need  to  accurately  identify  modal  frequencies  and  mode  shapes 
to  acheive  high-performance  disturbance  rejection  for  optical  or  RF  systems,  e.g.  ,  [1]. 
For  these  cases,  adaptive  control  mechanizations  were  shown  to  be  needed  to  produce  the 
three-to-five  orders-of-magnitude  reductions  in  line-of-sight  jitter  required  by  the  mission. 

'The  aim  of  adaptive  control  is  to  implement  in  real-time  and  on-line  as  many  as  pos¬ 
sible  of  the  design  functions  now  performed  off-line  by  the  control  engineer.  Although  it 
is  easy  to  configure  an  adaptive  system  by  connecting  an  estimator  and  control  design 
rule,  research  is  essential  to  identify  the  performance  limitations  of  adaptive  strategies  for 
LSS  control.  The  long  range  goal  of  this  research  program  is  to  establish  guidelines  for 
selecting  the  appropriate  strategy,  to  evaluate  performance  improvements  over  fixed-gain 
mechanizations,  and  to  examine  the  architecture  necessary  to  produce  a  practical  hard¬ 
ware  realization.  The  initial  and  continuing  thrust,  however,  is  to  build  a 
foundation  without  losing  sight  of  the  practical  implementation  issues. 
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2  Current  Status 

At  the  present  time  we  stand  at  the  beginning  stages  of  the  theoretical  development  in 
adaptive  control.  A  summary  of  earlier  efforts  is  contained  in  the  recently  published  text¬ 
book  Stability  of  Adaptive  Systems:  Passivity  and  Averaging  Analysis,  MIT  Press.  1986. 
This  publication  is  an  outgrowth  of  research  supported  under  this  contract  and  ir  /  jived  a 
considerable  amount  of  collaborative  effort  among  several  researchers  in  the  field  of  adap¬ 
tive  control.  The  text  discusses  adaptive  systems  from  the  viewpoint  of  stability  theory. 
The  emphasis  is  on  methodology  and  basic  concepts,  rather  than  on  details  of  adaptive 
algorithm.  The  analysis  reveals  common  properties  including  causes  and  mechanisms  for 
instability  and  the  means  to  counteract  them.  Conditions  for  stability  are  presented  under 
slow  adaptation,  and  the  result  is  shown  to  be  expressed  as  a  frequency  domain  constraint 
on  a  mix  of  frequency  respones  and  signal  spectrum.  These  Eire  greatly  influenced  by  user 
choices  regarding  data  filters  and  input  spectrum.  Some  of  the  issues  in  the  ideal  case  are 
explored  in  [13],  a  reprint  of  which  is  included  in  the  Appendix  of  this  report. 
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Under  this  contract  we  also  explored  the  feasibility  of  applying  the  averaging  analysis 
to  the  adaptive  control  of  a  nonlinear  flexible  system.  We  chose  a  Duffing  type  oscillator 
with  a  simple  adaptive  algorithm  as  a  test  case.  The  results  were  quite  promising  and  have 
been  reported  in  [18],  a  reprint  of  which  is  included  in  the  Appendix  of  this  report. 

Another  approach  to  adaptive  control  is  to  design  on-line  robust  controllers  from  esti¬ 
mators  which  produce  model  sets,  rather  than  a  single  model  estimate  usually  produced  by 
the  estimator.  This  estimation  problem,  referred  to  as  set  estimation  is  the  main  topic  of 
this  report,  and  is  also  a  topic  of  recent  research  activity.1  Under  AFOSR  support,  previ¬ 
ous  efforts  along  these  lines  have  involved  linear  set  estimation,  e.g.  ,  [15,16,17,19].  In  this 
report  we  show  how  these  methods  can  be  extended  to  nonlinear  flexible  systems.  Prelim¬ 
inary  results  are  presented  for  flexible  systems  with  uncertain  memoryless  nonlinearities 
at  different  locations. 

In  this  report  we  discuss  the  “separation  principal”  between  model  set  estimation  and 
robust  control  design.  This  procedure  allows  for  a  more  comprehensible  approach  to  adap¬ 
tive  control  design  and  differs  from  its  predecessors  in  that  model  uncertainty  is  incorpo¬ 
rated  in  the  synthesis  phase  of  the  design  rather  than  in  the  anlysis  phase.  By  studying 
some  typical  example  systems,  the  set  estimation  methodology  is  extended  to  the  nonlinear 
case. 

The  results  presented  here  for  nonlinear  systems,  although  of  a  preliminary  and  ex¬ 
ploratory  character,  do  indicate  the  feasibility  of  the  basic  approach  as  well  as  raising 
many  new  questions  which  need  to  be  considered  in  future  work,  e.g.  ,  what  is  the  appro¬ 
priate  robust  controller  parametrization;  how  does  it  relate  to  model  parametrization;  how 
to  iterate  on  the  data  if  the  estimate  of  model  error  is  too  large;  what  are  the  heuristics 
for  experiment  design.  It  is  clear  that  concurrent  effort  is  needed  for  both  nonlinear  set 
estimation  and  nonlinear  robust  control  design  -  the  former  cannot  be  effective  without 
the  latter. 


'Invited  sessions  have  been  organized  by  Dr.  Kosut  at  the  last  three  American  Control  Conferences 
(ACC)  under  the  title,  “System  Identification  for  Control  Design”.  A  fourth  is  scheduled  for  the  upcoming 
IEEE  Conference  on  Decision  and  Control  (CDC).  In  addition  a  mini-issue  is  being  planned  on  this  topic 
for  the  IEEE  Transactions  on  Automatic  Control.  Dr.  Kosut  is  one  of  the  Guest  Editors. 
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3  Design  of  Adaptive  Control  Systems 


There  are  many  ways  to  design  or  configure  an  adaptive  control  system.  Figure  1  depicts 
the  self-tuning-regulator  (STR)  configuration  [3j.  Two  feedback  processes  make  it  adaptive, 
namely:  (i)  a  model  parameter  estimator,  and  (ii)  a  control  design  rule. 
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Figure  1:  Self  Tuning  Regulator  (STR). 

The  parameter  estimator  operates  on  the  input-output  data  obtained  from  measurements 
(y,  u)  of  the  plant  system  and  produces  a  model  parameter  estimate  8  6  IRP.  The  parameter 
estimate  is  transformed  by  the  control  design  rule  into  a  controller  parameter  p  G  IRf,  which 
is  then  used  in  a  pre-determined  parametric  controller  structure  in  feedback  with  the  actual 
system. 

It  is  obviously  very  easy  to  construct  an  adaptive  system:  just  connect  a  control  design 
rule  and  an  estimator  together.  However,  it  is  very  difficult  to  insure  that  the  resulting 
adaptive  system  will  provide  acceptable  performance.  This  has  been  the  goal  of  research 
in  this  area  for  over  30  years. 

Roughly,  if  the  true  system  is  in  the  model  set  which  underlies  the  parameter  estimator, 
then  the  adaptive  system  will  asymptotically  reduce  the  error  signal  for  arbitrary  bounded 
exogenous  inputs  (r,  d ).  Technically  it  is  necessary  that  a  a  certain  (closed-loop)  transfer 
function  is  strictly-poitive-real  (SPR)  [23,11,2],  e.g.  ,  H(s )  is  SPR  if  it  is  stable  and  satisfies, 

Re[bT(ja;)]  >  0,Vo;  (1) 

The  main  difficulty,  to  put  it  simply,  is  that  the  true  system  is  never  in  the  model  set  - 
there  are  always  dynamical  phenomena  which  remain  unaccounted  -  and  unfortunately, 
the  SPR  condition  fails  to  hold.  Moreover,  the  theory  based  on  this  property  is  sufficient 
and  hence  does  not  predict  what  will  happen  if  the  SPR  condition  is  violated. 

Under  sufficiently  slow  adaptation  the  method  of  averaging  can  be  applied  to  expose 
a  mechanism  for  stability  and  instability  [2], [27], [3].  This  theory  replaces  the  above  SPR 
condition  with  a  “signal  dependent  positivity  condition”  of  the  form, 

^  —  J  R .e[H(juj)\S(u>)du>  >  0  (2) 
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where  S( u>)  >  0  is  a  spectral  density  matrix  associated  with  the  exogenous  inputs.  This 
condition  is  much  less  restrictive  because  even  if  H(jtj)  fails  to  satisfy  the  SPR  condition 
(1)  at  some  frequencies,  (2)  can  still  hold  provided  the  excitation  is  concentrated  at  those 
frequencies  where  Re[if(jtj)]  >  0.  Moreover,  if  any  eigenvalue  of  R  is  negative  then  the 
system  is  unstable.  In  using  the  theory  for  design,  the  user  must  select  an  appropriate 
combination  of  data  filtering  and  excitation  spectrum.  This  task  is  similar  to  problems 
encountered  in  system  identification  [22]  except  that  here  the  system  being  identified  is  in 
closed-loop,  which  vastly  complicates  the  selction  process. 

To  see  this  more  clearly,  consider  the  function  r($)  defined  via  Figure  2,  i.e.  ,  for  every 
parameter  choice  0  there  is  a  resulting  parameter  estimate  denoted  by  the  function  F($). 


Figure  2:  Illustration  of  the  parameter  map  T. 

It  is  shown  in  [24]  that  under  slow  adaptation,  convergence  points  of  the  STR  system  in 
Figure  1  are  precisely  the  fixed-points  of  Moreover,  the  fixed-point  is  stable  if  (2)  holds 
and  is  unstable  otherwise. 

In  summary,  the  averaging  result  shows  that  stability  of  the  (nonlinear)  adaptive  system 
can  be  deduced  from  a  frequency  domain  condition  (2)  which  mixes  signals  and  systems. 
However,  there  are  some  difficulties  in  utilizing  the  theory.  In  the  first  place,  it  is  no 
trivial  task  to  determine  the  fixed  point(s)  of  the  map  T,  i.e.  ,  those  6  6  IRP  satisfying 
6  =  r($).  Secondly,  both  the  transfer  function  H(s )  and  the  spectrum  S(ui)  depend  in  a 
complicated  manner  on  the  fixed-point  and  it  is  unclear  how  to  precisely  manipulate  data 
filters  and  input  spectrum  to  acheive  either  a  satisfactory  fixed-point  and/or  a  satsfactory 
transient  response  in  the  adaptive  parameter  trajectory.  To  put  it  bluntly,  the  theory  fails 
to  produce  a  “user  friendly”  design  method. 

If  we  agree  that  the  fundamantal  difficulty  in  analyzing  the  adaptive  system  is  the 
ubiquitous  model  uncertainty,  then  one  alternate  approach  is  to  configure  an  adaptive 
control  system  which  specifically  accounts  for  the  uncertainty.  One  such  scheme,  depicted 
in  Figure  3,  replaces  the  parameter  estimator  in  Figure  1  with  an  estimator  that  produces 
a  model  set  or  set  of  uncertainty.  This  would  avoid  the  major  obstacle,  namely,  that  the 
tiuc  system  is  not  in  the  model  set  used  for  identification.  This  type  of  estimator  is  referred 
to  as  an  uncertainty  estimator  or  a  set  estimator.  This  differs  from  the  estimator  in  the 
usual  adaptive  schemes  (c/.  Figure  1),  where  a  single  estimated  model  is  produced,  with 
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no  information  regarding  its  accuracy. 


Model  Set 


Figure  3:  Adaptive  control  with  uncertainty  estimation. 

The  second  change  is  to  use  a  robust  control  design  rule,  i.e.  ,  one  that  accepts  a  model  set 
in  the  form  produced  by  the  set  estimator.  Under  these  conditions,  if  the  true  system  which 
generated  the  measured  data  is  contained  in  the  estimated  set,  then  the  adaptive  system 
is  not  only  stable,  but  acheives  the  maximum  performance  possible  given  the  estimated 
set  of  uncertainty. 

Preceding  in  this  way  we  have  transformed  the  problem  of  adaptive  control  design  from 
analysis  with  trial-and-error  into  separate  synthesis  problems  in  set  estimation  and  robust 
control  design.  In  effect  this  is  a  “separation  principal”  analogous  to  that  in  the  LQG 
design. 

Set  estimators  should  at  least  have  the  following  features: 

•  Uncertain  Parameters.  A  capability  to  account  for  that  part  of  the  system  which  is 
known  to  be  governed  by  physical  laws  or  able  to  be  described  by  known  functions 
dependent  on  certain  constant  parameters.  The  parameters  may  only  be  known  to 
lie  within  some  range  of  variation. 

•  Uncertain  Dynamics.  Able  to  account  for  uncertain  dynamics  for  which  a  parametric 
structure  is  not  available  or  assumed,  e.g.  ,  neglected  high  frequency  flexible  modes, 
uncertain  memoryless  nonlinearities,  etc.. 

At  present,  methodologies  for  the  design  of  set  estimators  are  under  development,  e.g. 
,  [30],  [15],  [21],  [17], [10], [19],  [31].  On  the  other  hand,  there  is  a  reasonable  maturity  of 
methodologies  for  robust  control  design,  particularly  for  plants  with  uncertain  nonpara- 
metric  linear  dynamics,  e.g.  ,  [25],  [32],  [6,7],  [9],  [29].  Robust  control  design  of  plants  with 
parametric  uncertainty  seems  still  underdeveloped  despite  some  heroic  efforts,  e.g.  ,  see 
[4,5]  and  the  references  therein. 

In  the  remainder  of  the  paper  we  principally  address  set  estimation  for  linear  and 
nonlinear  systems.  Section  2  provides  a  review  of  some  recent  results  in  linear  set  estimation 
and  some  new  results  in  nonlinear  set  estimation.  Section  3  provides  a  brief  section  on  linear 
robust  control  of  plants  with  both  parametric  and  nonlinear  uncertainty  set  descriptions. 
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4  Linear  Set  Estimation 


Consider  the  linear-time-invariant  model  set: 

0(0,  W)  =  {Ge(l  +  AW)  :  6  G  0,  ||A||oo  <  1}  (3) 

The  set  £7(0,  W)  describes  both  parametric  and  nonparametric  uncertainty.  The  para¬ 
metric  uncertainty  is  reflected  in  the  set  {Gg  •  0  G  0}  where  Gg  is  a  parametric  transfer 
function  with  uncertain  parameters  6  G  0  C  IRP.  The  mapping  6  — >  Gg  is  known  but  the 
exact  parameter  values  are  known  only  to  be  in  some  set  0.  The  nonparametric  uncer¬ 
tainty  is  reflected  in  the  set  {A  :  UAjjoo  <  1}.  Thus  A  is  an  uncertain  linear-time-invariant 
system  only  known  to  be  stable  and  unity  bounded  in  the  Tfoo-norm,  which  for  continu¬ 
ous  time  systems  is  defined  as  |] A|[oo  =  sup^j^  |A(yu;)|  and  for  discrete  time  systems  as 
|| A ||oo  =  sup|w|<ir  |A(eJU/)|.  W  is  a  stable  transfer  function  which  reflects  the  size  of  the 
relative  (or  multiplicative)  uncertainty,  i.e.  , 

l|A|U  =  ll^irlu-1 

The  above  expression  suggests  interpreting  the  set  £?(0,  W)  as  a  set  of  transfer  functions 
“centered”  at  the  parametric  transfer  function  Gg  with  a  “radius  of  uncertainty”  of  GgW. 

It  is  usually  possible  in  a  modeling  process  to  arrive  at  an  initial  parameter  set  0O  and 
a  weighting  transfer  function  W0.  In  the  case  when  the  prior  set  £7(©0,  Wo)  is  too  coarse 
to  lead  to  tolerable  closed-loop  performance  levels,  then  a  model  set  estimator  is  required 
to  refine  the  prior  information  by  making  use  of  measured  data.  Specifically,  we  extract 
the  following  result  from  [19]. 

Theorem 

Suppose  that  the  the  measured  data  set 

{y, u  :  t  =  1, . . . ,  N} 

is  obtained  from  the  sampled-data  system 

V  =  Gu 

where  G  has  the  discrete-time  transfer  function  G(z).  Furthermore,  suppose 
that  from  prior  information 

GeQ(Qo,W0) 

and  the  parametric  transfer  function  in  (8)  has  the  structure: 

Bg(z)  _  bi z~J  -j - h  bmz~m 

Ag(z)  l+aiZ-1-(- - h  anz~n 

[qj  •  (ln  b\  •  '  &rn] 


Gg(z)  = 

eT  = 
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Under  these  conditions,  if  G  is  initially  at  rest,  and  is  either  stable  or  in  a 
stabilizing  feedback,  then: 

GeQ(Q0,w0 )  n  g(eN,w0)  (4) 

where  Ojv  is  the  •parameter  s°t  estimate, 

Qn  =  {#  :  || Agy  —  Dgu\\ ^  <  ||i?0Wou||jv}  (5) 

with  the  N -point  signal  norm  ||:r||^  =  x(t)2 . 

The  above  result  implies  that  if  the  true  parametric  transfer  function  is  Ggltuc,  where 
#irue  €  IRP  is  the  true  parameter  value,  then 

$tnis  €  Oo  0  0N 

A  good  data  set  would  insure  that  the  new  set  estimate  is  strictly  inside  the  prior  estimate, 
that  is 

0O  n  6wc  0O 

Since  both  Ag  and  Dg  are  affine  functions  of  6 ,  it  can  be  shown  [19]  that  On  describes 
either  an  ellipsoid  or  an  hyperboloid  in  IRP,  depending  on  the  data.  Moreover,  although 
the  set  0O  0  0at  is  not  an  ellipsoid,  nonetheless  a  bounding  ellipsoid  can  be  obtained. 

A  similar  result  is  obtained  in  [31]  for  a  co-prime  factor  nonparametric  uncertainty 
structure  rather  than  the  multiplicative  one  used  here.  More  on  bounding  ellipsoids  can 
be  found  in  [8]  who  considered  the  problem  of  parameter  set  estimation  with  bounded 
noise  and  no  unmodeled  dynamics. 
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5  Nonlinear  Set  Estimation 


The  preceding  principals  of  set  estimation  for  linear-time-invariant  systems  can  be  applied 
to  the  set  estimation  of  nonlinear  systems.  We  will  illustrate  the  problems  using  the 
following  three  example  systems:  (i)  an  input  nonlinearity,  (ii)  an  output  nonlinearity,  and 
(iii)  a  mechanical  system  with  backlash. 

5..1  Example  1:  Input  Nonlinearity 

Consider  the  system  shown  in  Figure  4  and  described  by: 

y  =  Geu,  u  =  /0)  (6) 


U 

/(•) 

U 

Gn 

Figure  4:  Input  nonlinearity. 

Make  the  following  assumptions: 

1.  The  function  /(•)  is  a  memoryless  time-invariant  nonlinearity  known  to  lie  in  the 
sector 

|/(u)  —  ku\  <  £|u|,  V|u|  <  p  (7) 

where  S  <  k  and  p  >  0  arc  known  constants. 

2.  Go  is  a  continuous-time  linear-time-invariant  system  with  stable  transfer  function 
Ge(s)  and  where  6  6  IRP  are  uncertain  parameters. 

3.  The  measured  data  set  is 


{y(*)>M(0  :  <  = 

where  the  time  t  is  normalized  to  the  sampling  interval. 

The  constants  ( k,6,p )  quantify  the  uncertainty  in  the  nonlinear  function  /(•)  in  much  the 
same  way  that  W  bounds  the  uncertain  linear-time-invariant  nonparametric  dynamics  in 
the  previous  section.  A  problem  here,  though,  is  that  u,  the  input  to  the  linear  part  of  the 
systen  ,  is  not  a  measured  variable.  Moreover,  the  nonlinear  function  precludes  describing 
any  discrete-time  transfer  function  from  u  into  y.  However,  provided  /(•)  is  sufficiently 
smooth,  for  fast  sampling  we  have  the  following  sampled-data  approximation 

y  ~  Geu ,  u  =  /(«)  (8) 
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where  now  Gg(s )  is  approximated  by  the  zero-order-hold  z-transform 

Ge(z)  =  (l-z-')Z{-Ge(s)} 

s 

This  approximation  is  only  valid  at  the  sample  times  t  €  {1, . . . ,  N}.  For  example,  if  /(•) 
is  a  polynomial  or  rational  function,  then  there  certainly  exists  a  (not  necessarily  small) 
region  \u\  <  p  such  that  (7)  holds. 

To  illustrate  the  problems  in  obtaining  a  set  estimator  even  for  the  approximate  system 
(8),  suppose  that  (k,  8 ,  p)  are  known,  and  we  wish  to  estimate  a  parametric  model  for  Gg(z). 
For  illustrative  purposes,  suppose  that  G$(z)  is  in  the  two-parameter  set: 


Ge(z) 


Be{z) 

Ag(z) 


bz -1 

1  -f  az~l  ’ 


e  = 


a 

b 


0) 


After  some  algebra  one  obtains  the  following  equivalent  input/output  description  of  (8): 


Aey  -  D0u  =  Bge  (10) 

where  e(t)  is  an  uncertain  sequence  satisfying 

WOI  <  |kOI,  Vi  =  i (11) 

Since  (k,8,p)  are  known  and  u(t)  is  measured,  the  upper  bound  on  the  error  sequence 
is  known  at  each  time  instant.  Combining  the  above  expressions  with  prior  information 
0  G  0O,  we  obtain  the  parameter  set  estimate 


0O  n  qn 


where  0a r  consist  of  those  6  satisfying, 

£ 

I y(t)  +  ay(t  -  1)  -  bu(t  -  1)|  <  -| bu(t  -  1)|,  (12) 

for  all  t  =  1, . . . ,  N . 

5. .2  Example  2:  Output  Nonlinearity 

In  the  above  example,  the  nonlinearity  was  on  the  input.  Now  consider  the  case  where  the 
nonlinearity  is  on  the  output  (see  Figure  5)  where 

v  =  f(y),  y  =  Ggu  (13) 

Preceding  as  before  we  now  have, 

A„y  —  Bqu  =  Age  (14) 
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u 


y 


Figure  5:  Input  nonlineaxity. 
where  now  e(t)  is  an  uncertain  sequence  satisfying 

KOI  -  £3$  KOI*  (15) 

In  this  case  the  set  estimate  On  consists  of  those  6  satisfying, 

|y(0  +  «y(*  - !)  -  M*  -  i)l  <  (KOI  +  |ay(<  - 1)|) ,  (16) 

for  all  t  =  1, . . . ,  Ar. 

5. .3  Example  3:  Mechanical  System 

Consider  the  mechanical  configuration  depicted  in  Figure  6. 


Figure  6:  A  flexible  rotating  system  with  backlash  in  the  gear-train. 

This  system  represents  the  case  where  tortional  actuation  is  applied  to  a  load  through 
a  flexible  gear-train.  The  gearing  is  shown  to  occur  at  the  end  of  the  flexible  member, 
although  other  combinations  are  certainly  possible. 

Neglecting  any  electronic  dynamics,  and  assuming  that  the  flexible  rod  is  both  uniform 
and  damped,  the  motion  of  the  rigid  body  and  first  tortional  “mode”  for  small  angular 
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deflections  can  be  approximated  by  the  system  of  differential  equations, 


=  u  +  D(y 2  - 

yi)  +  k(v2  ~ 

yi) 

Jg\I2 

=  —u  —  D(y  2 

-yi)  -  I<(y2 

-  2/i 

JlVs 

-  Nu 

y 

S> 

1 

CN 

ll 

u 

=  f(y) 

where  u  denotes  the  input  applied  torque,  {y\,y2,yz)  are  angular  deflections  as  indicated 
in  the  figure,  y  is  the  relative  gear  angle,  and  /(•)  is  a  memoryless  nonlinearity  arising 
from  backlash  in  the  gear  train.  The  constants  are  defined  as  follows:  J^,  Jq,  and  Ji  are 
the  motor,  motor  gear,  and  load  inertias,  respectively,  N  is  the  gear  ratio  which  is  greator 
than  one,  and  D,  K  are  the  damping  and  stiffness,  respectively,  of  the  elastic  rod.  The 
backlash  nonlinearity  /(•)  has  the  typical  shape  as  shown  in  Figure  7. 


Figure  7:  A  typical  backlash  function. 


The  break-point  parameter  xjb  relates  to  gear  teeth  spacing  and  the  slopes  in  the  two 
regions  relate  to  gear  teeth  shapes.  Typically  for  \z\  >  yb  the  slope  is  very  large  whereas 
for  \z\  <  yt,  the  slope  is  very  small.  It  is  clear  that  for  some  positive  constants  (fc,6,  p)  that 
/(•)  satisfies  the  sector  condition  (7). 

To  illustrate  how  to  compute  a  set  estimate  for  the  parameters  of  the  mechanical 
system,  suppose  that  the  measured  variables  are 


and  that  ( K,D )  are  uncertain  parameters,  i.e.  , 


Observe  that  the  input  to  the  nonlinear  function  is 
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One  approach  to  describing  a  model  set  lor  this  type  of  system  is  to  approximate  either 
the  input  or  output  to  the  nonlinear  function.  This  would  be  like  the  ideal  situations  in 
the  preceding  two  example  systems.  In  this  case,  since  y3  is  available  as  a  measurement, 
the  acceleration  y 3  can  be  approximated  by  high  pass  filtering  the  measured  output  y3. 
For  example,  let 

£  =  ^3,  = 

where  1/r  is  sufficiently  large  so  as  to  capture  the  dominant  harmonics  in  the  acceleration. 
Then, 

_  „  Jl^ 

«  ~  u  -  JTVz 

With  this  approximation  the  situation  is  very  similar  to  the  example  where  the  nonlinearity 
is  on  the  output.  However,  there  is  one  difference:  here  the  input  to  the  nonlinear  function 
also  contains  a  term  do  to  u ,  which  can  also  be  approximated  by  u.  Thus,  the  appropriate 
model  can  be  described  by  the  feedback  system  shown  in  Figure  8. 


u 


Figure  8:  Feedback  nonlinearity. 


The  system  is  described  by, 

u  =  /(y),  y  =  Ge 

After  some  algebra,  we  obtain, 


X 

,  X  - 

y 

u 

u 

Jmu  +  Jgu  , 

y  ~  v  =  -  • - ~A - +  yi  -  Ny3 


(17) 


where 

Afl(s)  =  JmJgs2  +  ( Jm  +  Jg)(Ds  +  K) 

The  procedure  described  in  Example  1  can  now  be  applied  to  obtain  a  set  estimate  which 
will  contain  the  true  parameters.  Of  course  the  precise  conditions  under  which  the  true 
parameters  are  in  the  set  estimate  involve  various  approximations.  In  particular,  due 
consideration  must  be  given  to  approximating  -u  by  tx. 
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5.1  Standard  Model  Structure 


Even  though  the  three  example  systems  are  fairly  general,  it  is  also  important  to  point 
out  that  they  do  not  exhaust  ail  the  myriad  possibilities.  A  very  general  model  format,  or 
template,  is  characterized  in  Figure  9. 


u 

u 


y 

y 


Figure  9:  Standard  model 

This  model  form  is  discussed  in  detail  in  [20] .  Here  we  make  the  following  assumptions: 


1. 


2. 


Pg  is  a  transfer  matrix  which  depends  on  a  parameter  6  €  1RP  and  which  has  the 
block  structure: 


y 

"  Pn 

Pl2  ' 

U 

.  y . 

[Pn 

P 22 

U 

/(•)  is  a  scalar  memoryless  nonlinearity  in  the  sector, 

az  <  f(z )  <  /3z ,  V|z|  <  p 


(18) 


where  0  <  a  <  (3. 

3.  The  measured  data  set  is 


{y(t),u(t)  :  t  = 

The  standard  form  allows  for  scalar  memoryless  sector  bounded  nonlinearties,  but  the 
measured  signals  (y,u)  can  be  vectors.  Disturbances  as  well  as  nonparametric  dynamic 
uncertainties  can  also  be  included  by  replacing  the  “feedback”  with  a  more  complicated 
system  and  by  adding  another  input. 

For  the  three  example  systems  /  is  in  the  sector, 

( k  —  S)u  <  f(u )  <  (k  +  6)u,  V|u|  <  p 


where  h  <  k. 
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For  the  system  in  Example  1  (8), 


Pe 


For  the  system  in  Example  2  (10), 

Pe 


0  Ge  ' 

1  0 


0  1 

Ge  0 


And,  for  the  system  in  Example  3  the  transfer  matrix  Pe  has  the  block  structure  (18) 
with: 


Pu 

Pi  2 

P21 

Pn 


_ Ds  +  K _ 

s2\Jm  Jgs2  +  ( J\i  +  Jg)(Ds  +  /v  )] 

N 

_ Ds  +  K _ 

s2[Jm  Jg$2  +  (Jm  +  Jg)(D +  K)] 

N- _ JMs2  +  Ds  +  I< _ 

s2Ji  s2[JmJgs 2  +  (Jm  +  Jg)(Ds  +  K )] 


In  Example  3  we  used  the  feedback  approximation  (17)  which  yields 


Pe  = 


0  I 
Ge,  i  Ge,  2 


where  Ge  in  (17)  has  the  block  structure 


Ge  —  [G<?,i  Ge, 2] 

These  examples  demonstrate  that  a  very  large  class  of  mechanical  systems  can  be  captured 
by  the  standard  form  of  Figure  9. 

When  Pjj1  exists,  the  input  and  output  to  the  nonlinear  function  is  given  by: 


ye  =  P21U  +  P22Pi21(y  -  Pnu)  (19) 

i i8  -  Pn(v  “  Ai«)  (20) 


We  have  explicitly  used  the  6  subscript  to  indicate  the  parameter  dependence.  Thus,  the 
parameter  set  estimate  follows  directly  from  the  sector  condition  as, 


0yv  =  {0  ■  ou&(t)  <  ye(t)  < /3ue(t),  Vt  =  l,...,A7}  (21) 

Observe  also  that  in  the  case  when  ( u,y )  are  vector  signals,  the  above  will  still  hold  if  PiV 
is  replaced  with  the  pseudo- inverse 

pi  =  (P?,Pn)-'PL 
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The  standard  model  structure  (Figure  9)  can  also  handle  multiple  sector  nonlinearities 
by  replacing  /(•)  with  a  diagonal  matrix  nonlinearity 

u  =  F(y )  =  diag[/i(y! )  •  •  •  fp(yp)\ 

where  (u,y)  are  now  vector  quantities.  The  sector  conditions  can  now  apply  to  each  of  the 
diagonal  entries. 
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5.2  Disturbance  Modeling 

To  make  the  model  sets  more  realistic  it  is  necessary  to  account  for  disturbances.  For 
example,  consider  (8)  with  an  additional  disturbance  term  d(t), 

y  =  G6u  +  d,  u  —  f(u ) 

With  Ge  =  Bg/Ag  we  now  obtain, 

Agy  —  Dgu  =  Bge  -F  Agd  (22) 


where  e(t)  satsifies  (11) 

|e(*)|  <=  ^|u(t)|,  Vt  =  l,...,N 

Suppose  that  d(t)  is  unknown  but  bounded  by, 

\d(t)\<dm,  V<  =  1, . . . ,  iV  (23) 

I11  effect  both  e(t)  and  d(t)  have  known  bounds  and  by  analogy  with  the  preceding  example 
we  can  easily  construct  (in  principal)  the  corresponding  set  estimates. 

It  is  obvious  though  that  there  are  many  forms  for  how  a  disturbance  can  influence 
a  particular  system.  This  leads  to  considering  the  standard  model  with  an  additional 
disturbance  input  as  shown  in  Figure  10. 


d, 

XL 


y 

y 


Figure  10:  Standard  model  with  disturbance. 


17 


5.3  Nonparametric  Uncertainty 


A  more  versatile  model  set  would  not  only  include  disturbances  and  sector  nonlinearities, 
but  also  uncertain  nonparametric  linear-time-invariant  dynamics.  For  example,  consider 
the  system  described  by: 


y  =  G<j(l  +  AW)u  +  d,  u  =  f(u)  (24) 

where  /(•)  is  a  sector  nonlinearity,  d{t )  is  a  bounded  disturbance,  A  is  an  uncertain  transfer 
function  which  satisfies  (lAHoo  <  1,  and  W  is  a  known  stable  transfer  function. 

Now,  reconfigure  the  system  into  a  “structured”  standard  form  as  in  [7,26]  shown  below 
in  Figure  11. 


y 

y 


Figure  11:  Standard  model  with  disturbance  and  uncertainty. 


Here  the  “feedback”  matrix  operator  X  contains  all  the  model  uncertainty, 


X  = 


/(■)  0 

0  A 


It  is  the  diagonal  structure  of  this  matrix  operator  which  causes  difficulties  in  computing 
an  optimal  model  set. 
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6  Robust  Control  Design 

6.1  Robust  Nonlinear  Control 

There  are  some  well  developed  approaches  to  nonlinear  control  design.  For  example,  there 
are  the  classical  methods  of  gain  scheduling,  analysis  via  harmonic  balancing  (describing 
function  analysis),  and  the  method  of  feedback  linearization.  This  latter  approach  is  ef¬ 
fectively  a  generalized  gain  scheduling  procedure.  In  fact  it  is  a  true  synthesis  method, 
that  is,  a  nonlinear  control  is  directly  designed  from  the  nonlinear  model  [14].  The  basic 
idea  is  to  apply  a  nonlinear  feedback  which  brings  the  closed-loop  system  into  a  purely 
linear  form,  which  has  obvious  advantages  for  control  design.  A  difficulty  with  the  method 
is  that  the  linearizing  feedback  requires  an  exact  knowledge  of  the  type  of  system  non- 
linearities.  Moreover,  the  control  is  typically  much  more  complex  than  a  gain  schedule, 
which  bothers  many  design  engineers.  However,  one  can  argue  that  feedback  linearization 
can  give  the  designer  a  means  to  evaluate  the  limits  of  achievable  performance  from  a 
feedback  system.  Robustness  of  feedback  linearization  to  model  errors  is  an  open  area  in 
basic  research.  Some  work  on  robustness  to  uncertian  nonlineaxities  has  been  advanced  in 
the  robotics  area,  where  feedback  linearization  is  there  referred  to  as  “computed  torque” , 
[28].  Developing  robust  nonlinear  control  is  an  area  for  some  future  work.  To  gain  some 
insight  into  the  issues  we  consider  next  the  case  of  robust  linear  control  of  an  uncertain 
nonlinear  system. 

6.2  Robust  Linear  Control  of  Nonlinear  Model  Sets 

The  premise  is  that  the  uncertainties  are  described  via  prior  information  on  the  nonlinear 
sector  and  a  set  estimator  which  describes  the  range  of  uncertain  parameters  in  the  linear¬ 
time-invariant  part  of  the  system. 

As  an  illustrative  example,  consider  the  uncertain  nonlinear  plant  with  a  linear  feedback 
control, 

y  =  d  +  f(y),  y  =  Ggu,  u  = -Ky  (25) 

where  Ge  and  K  are  linear-time-invariant  systems,  K  is  the  linear  feedback  controller, 
/(•)  is  a  memoryless  nonlinearity,  y  is  the  measured  output  to  be  controlled,  and  d  is  a 
disturbance  as  seen  at  the  output.  The  control  objective  is  to  attenuate  the  effect  of  the 
disturbance  at  the  output  despite  the  uncertainties  in  the  system  model.  Specifically,  the 
system  uncertainties  are  as  follows: 

•  the  nonlinear  function  /(•)  is  in  the  sector, 

1/(27)  -  y\  <  V|y|  <  p 

•  the  parameters  in  the  linear-time-invariant  system  Ge  are  in  the  set  0. 
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Observe  that  these  uncertainty  sets  can  arise  from  a  combination  of  set  estimation  and/ or 
prior  information.  From  the  control  design  viewpoint  the  source  of  the  uncertainty  is  not 
relavent. 

To  analyze  this  system  we  make  the  following  convenient  defintions: 

A(y)  =  f(y)-y 
Se  =  (1  +  GeK)-1 
To  =  GeK(  1  +  GeK)-'  =  1  -  Se 

Observe  that  A(-)  satisfies  the  sector  condition 

|A(y)l  <  %|,  V|y|  <  p 

The  transfer  functions  (So, To)  are  the  closed-loop  transfer  functions  from  disturbance  d 
to  output  y  and  control  u,  respectively,  if  the  nonlinear  function  /(-)  is  replaced  by  the 
identity  operator,  which  in  this  case  is  the  “nominal”  nonlinearity.  The  nonlinear  feedback 
system  is  then  equivalently  expressed  as: 

y  =  S*(<i  +  e) 

£  =  A(y) 

y  =  —To(d  +  e) 

Now,  let  Tg(t )  denote  the  impulse  response  of  T$(s),  and  suppose  that  there  are  constants 
M  >  1,  a  >  0,  and  r  >  0,  independent  of  9,  such  that  for  all  t  >  0, 

|T,(<)|  <  Me~at 

|(Tfld)(t)|  <  r 

Application  of  the  Bellman  inequality  [12]  yields: 

provided  that 


r  <  (1  —  6M/a )  p 

The  above  inequalities  bound  e(t),  which  appears  as  an  additional  disturbance.  Thus,  the 
ideal  closed-loop  transfer  functions  (So,  To)  must  be  shaped  to  make  e(t)  small.  In  addition, 
the  linear  controller  K  has  other  goals  e.g.  ,to  robustly  stabilize  the  linear-time-invariant 
model  set  [Go  '■  ^6  0}. 
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Abstract  A  slowly  adapting  feedforward  controller  is 
applied  to  a  nonlinear  (Duffing)  oscillator.  Simulation 
results  show  that  the  adaptation  continues  relentlessly 
to  improve  performance  despite  the  complex  system  be¬ 
havior,  t.e.  ,  the  system  state  passes  in  and  out  of 
both  chaotic  and  multi-periodic  attractors,  finally  settling 
down  to  a  “quiet”  periodic  orbit.  An  analysis  is  presented 
based  on  the  method  of  averaging.  Under  slow  parameter 
adjustment  it  is  shown  that  the  source  of  the  complex  be¬ 
havior  is  the  nonlineariy  in  the  system  being  controlled, 
not  that  introduced  by  the  adaptation. 

1  Introduction 

Adaptive  control  systems  can  be  generically  represented1 
by  the  set  of  coupled  ordinary  differential  equations: 

x  =  g(t,x,9)  (1) 

e  =  7  f(t,x,0)  (2) 

In  (1),  x  €  IR”  is  referred  to  as  the  "state”  and  con¬ 
sists  of  dynamical  states  of  the  system  being  controlled, 
controller  states,  and  filter  states  in  the  parameter  esti¬ 
mator.  The  function  g(t,x,9)  is  determined  by  the  sys¬ 
tem  dynamics  and  the  controller/estimator  design.  In  (2), 
0  €  ITF  is  the  adaptive  parameter  whose  rate  of  adjust¬ 
ment  is  governed  by  a  scalar  constant  7  >  0,  referred  to  as 
the  adaptation  gain,  and  a  function  f(t,x,9)  determined 
by  the  designer.  Observe  that  when  the  parameters  are 
held  fixed,  the  system  is  governed  by  the  nonlinear  system 
(1)  for  constant  parameter  6. 

In  the  case  of  an  adaptive  linear  system,  (l)-(2)  reduce 
to, 

x  —  A(6)x  +  B(9)w(t)  (3) 

0  =  7  f(t,x,0)  (4) 

where  ui(t)  £  IRm  consists  of  all  exogenous  inputs  such 
as  references  and  disturbances,  and  A(9)  £  IRnxn  and 
B{6)  £  IRnXm  are  matrix  functions  of  the  parameter  9 , 
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the  specific  f  ons  depending  on  the  control  design  rule 
'  d  the  parameter  estimation  model  set.  In  this  case 
w..cn  the  p.  -ameters  are  held  fixed,  the  system  is  gov¬ 
erned  by  the  I  system  (3)  with  9  constant. 

An  adaptive  control  system,  although  a  special  type  of 
nonlinear  system,  is  nonetheless  a  nonlinear  system,  and 
as  such  one  would  expect  to  encounter  limit  cycles,  bifur¬ 
cations,  and  chaos.  In  the  case  of  adaptive  linear  control 
(3)-(4)  ,  these  latter  phenomena  are  known  to  occur  as 
the  adaptation  speed  is  increased  (large  7),  e.g.  ,  (Mareels 
and  Bitmead(1986,1988)],  [Salam  and  Bai(  1 988)] ,  [Cyr  el 
a/.(  1 983)] ,  [Riedle  and  Kokotovic(1984)],  and 
[Ydstie(198G)].  Thus,  rapid  adaptation  alone  can  induce 
bifurcating  and  chaotic  behavior. 

In  this  paper  we  explore  the  case  of  adaptively  con¬ 
trolling  a  nonlinear  system  under  slow  adaptation  (small 
7).  As  we  will  see,  chaotic  phenomena  will  appear  primar¬ 
ily  because  of  nonlinearity  in  the  system  being  controlled, 
and  not  because  of  adaptation.  Specifically,  we  examine  a 
Duffing  system  under  feedforward  model  reference  adap¬ 
tive  control  with  slow  adaptation.  A  simulation  study 
is  performed  along  with  an  analysis  using  the  method 
of  averaging,  which  has  proven  to  be  very  successful  for 
slow  adaptation  of  linear  systems,  e.g.  ,  Anderson  el 
al.(  1986),  Sastry  and  Bodson(1988),  Astrom  and  Witten- 
mark(1989). 

2  Adaptive  Duffing  System 

The  system  to  be  controlled  is  the  Duffing  system: 

x  +  kx  +  x3  =  u  (5) 

where  k  >  0  is  a  small  damping  coefficient,  x  is  a  mea¬ 
sured  output,  and  u  is  the  control  input.  Prior  knowlege 
of  the  damping  and  cubic  nonlinearity  is  assumed  unavail¬ 
able,  and  hence,  we  implement  the  adaptive  control: 

u  =  9r 

9  =  7r(r  —  x) 

The  adaptive  parameter  is  9,  a  feedforward  control  gain, 
7  >  0  is  the  adaptation  gain,  and  r  is  a  reference  com¬ 
mand  which  is  to  be  followed  by  the  output  x.  This  adap¬ 
tation  rule  is  an  approximation  of  a  so-called  “gradient” 
rule  where  the  rate  of  adjustment  is  proportional  to  the 


negative  gradient,  with  respect  to  the  parameter  8,  of  an  initial  conditions 
instantaneous  error  function.  In  this  case  the  exact  gra¬ 
dient  rule  is 


(0,jr,i)  =  (75,0,0) 


d 

8 - —(x  -  r)2  ~  xP(r  -  x) 

where  xl’  is  the  instantaneous  gradient  of  x,  that  is,  ip  = 
dx/dO.  Thus,  for  constant  0 ,  ip  satisfies  the  differential 
equation 

ip  +  kip  +  3  x2ip  =  r 

Since  t b  depends  on  the  unknown  damping  and  cubic 
nonlinearity  in  the  system  (5),  the  pure  gradient  rule 
6  —  71 p(r  —  1)  cannot  be  implemented.  Using  the  (crude 
but  simple)  approximation  ip  %  r  yields  the  algorithm  of 
(6). 

Before  studying  the  adaptive  system  (5)-(6)  ,  recall 
that  the  Duffing  system  (5)  for  constant  9  has  been  ex¬ 
tensively  examined.  In  particular,  Ueda  [Ueda(1980)] 
made  an  exhaustive  study  with  u  =  B  cost  and  tabu¬ 
lated  the  resulting  long-term  behavior  as  a  function  of  the 
parameters  ( k.B ).  For  example,  with  (k.  B)  —  (.08,  .2), 
there  are  five  coexisting  periodic  attractors,  whereas  for 
(k.B)  =  (.05,7.5),  (.25,8.5),  or  (.1,12.),  the  attractors 
are  all  chaotic.2 

As  an  example,  for  ( k,B )  =  (.05,7.5),  Figure  1(a)  dis¬ 
plays  a  plot  of  points  of  i(f)  vs.  x(t)  at  900  27t-periodic 
strobe  times,  i.e.  ,  t  e  {2 irk  :  k  =  1, . . .  250(2tt) } .  Such 
a  plot  is  referred  to  as  a  Poincare’  section.  Figure  1(b) 
shows  a  corresponding  time  history  of  x(t)  vs.  x(t)  for  50 
periods  of  the  reference  u  —  7.5  cos t,  i.e.  ,  t  €  [0,50(2*-)]. 

Given  the  quite  complex  behavior  of  the  system  (5) 
when  0  is  constant  and  r  is  a  sinusoidal  reference,  it  is  to 
be  expected  that  if  0  is  slowly  adapted,  then  the  system 
(5)-(6)  will  pass  through  regions  which  contain  chaotic 
and/or  multi-periodic  attractors. 


3  Simulation  Results 


Simulations  of  (5)-(6)  using  MATRIXx  software  were  per¬ 
formed  under  the  following  conditions: 


re fe  re  n  ce 


damping 


adaptation  gain 


r  =  A  cos  t,  A  =  0 . 1 


k  =  .05 


(  0  0  <  t  <  250(2*-) 

7=<  01  250(2*)  <  t  <  750(2*) 

[  .05  750(2*)  <  t  <r  4250(2*) 


integration  algorithm 

4th-order  Kutter-Merson  integration  algorithm 
with  a  fixed  step-size  equal  to  1  /200th  of  the  pe¬ 
riod  of  the  reference  signal  r,  i.e. 

T  =  2tt/200  (7) 

To  initialize  the  system  there  is  no  adaptation  (7  =  0) 
for  the  first  250  periods.  This  is  followed  by  500  periods 
of  very  slow  adaptation  (7  =  .01),  and  then  the  remain¬ 
der  of  the  time  at  relatively  slow  adaptation  (7  =  .05). 
The  adaptive  gain,  7,  was  chosen  to  produce  slow  adapta¬ 
tion  to  prevent  any  possible  bifurcations  and  chaos  soley 
as  a  result  of  too  rapid  an  adaptation,  which,  as  previ¬ 
ously  mentioned,  is  known  to  occur  in  adaptive  systems 
even  when  the  system  being  controlled  is  linear.  Thus, 
initially  after  the  adaptation  begins,  Or  «  7.5 cost.  Re¬ 
ferring  to  Figure  1,  the  initial  response  of  (5)-(6)  will 
be  chaotic.  What  we  hope  to  see  is  that  the  adaptation 
brings  the  system  to  a  more  quiescent  condition,  which 
in  fact  is  what  occurs.  Figures  2-  3  show  the  results  of 
the  simulation  over  4250  periods  of  the  reference,  i.e.  , 
for  0  <  t  <  4250(2*-). 

Figure  2(a)  shows  values  of  x  and  0  at  the  1-period 
strobe  times  t  6  {2* k  :  k  —  1 , . . . ,  4250} .  Figure  2(b) 
shows  the  ( x,0 )  Poincare’  section  at  these  strobe  times. 
Note  that  time  increases  as  0  decreases  in  this  figure.  The 
plots  show  that  as  6  is  adapted,  the  system  passes  in  and 
out  of  chaotic  and  periodic  behavior.  Specifically,  reading 
Figure  2(a)  or  (b)  from  left  to  right:  (initially)  chaotic 
— ►  3-periodic  — *■  chaotic  — •  2-periodic  — *  1-periodic  — * 
chaotic  — ►  3-periodic  — *  (finally)  1-periodic.  Despite  this 
complex  behavior,  the  adaptation  of  0  continues  to  im¬ 
prove  performance.  In  fact,  as  we  shall  shortly  demon¬ 
strate,  the  adaptive  parameter  asymptotically  approaches 
a  small  neighborhood  of  the  constant  value  of  6  which 
minimizes  the  average  of  (x  —  r)2.  This  is  precisely  the 
desired  property  of  the  so-called  gradient  algorithm  (6). 

Figures  3(a)-3(k)  show  samples  of  the  system  state 
( 0,x,x )  from  four  perspectives: 

(1) upper  left:  5  periods  of  phase  plane  (x,x). 

(2 ) upper  right:  5  periods  of  of  (f?,x,x)  vs.  t. 

(3) lower  right:  A  crude  spectral  decomposition  of  x(t) 
over  5  periods  using  the  discrete  Fourier  transform, 

1  jV_1 

=  Jj  5>(fcT)expjwfcT 

]  k~0 


’Simulations  and  reprints  of  some  of  the  results  in  [Ueda.  1980] 
can  be  found  in  many  rerent  texts,  e.g.  ,  Thompson  and  Stew- 
art(lU8(>),  Moon(  1988). 


with  T  =  2*-/200  from  (7),  N  =  5(2t)/7'+  1  =  1001,  and 
w  €  {.05fc  :  k  =  0, 1.. . .,  100}. 


{4)  lower  Icjl :  An  (x,  0)-Poincare’  section  over  300  pe¬ 
riods,  the  last  5  periods  being  those  in  the  above  plots. 
Observe  that  time  t  flows  in  the  direction  that  0  deceases. 

Comparison  of  the  initial  chaotic  phase  plot  in  Fig.  3(a) 
with  the  final  periodic  phase  plot  in  Fig.  3(k)  shows  a 
significant  improvement  in  performance  as  exhibited  by 
the  spectral  plots. 


4  Averaging  Analysis 


In  this  section  we  provide  an  analysis  of  the  simulation 
results  using  the  method  oi  averaging.  Following  the 
approach  described  in  Anderson  et  a/.(1986),  let  x(t,0) 
denote  the  frozen  parameter  slate  corresponding  to  the 
adaptive  nonlinear  system  (5)-(6)  .  That  is,  for  constant 
0,  x(t,0)  satisfies  the  forced  Duffing  system: 

x  +  lex  +  x3  =  BA  cos  t  (8) 

Then,  the  “averaged  parameter  system”  is  defined  as  so¬ 
lutions  of  the  autonomous  system 

o  =  7/av(tf)  (9) 

where  for  constant  0. 

fav(0)  =  avg  {r( •)[»-(•)  -  f(-,<?)]}  (10) 

with  avg{-}  denoting  the  averaging  operation 

rp 

avg{x(-)}  =  lim  ^  /  x{t)dt  (11) 

r— oo  i  j  q 

The  method  of  averaging  tells  us  (roughly)  that  for  all 
small  7  >  0,  there  exist  solutions  0(t )  of  the  adaptive 
system  (5)-(6)  which  are  within  order-7  of  equilibria  of  the 
averaged  system  (9)  and  which  inherit  the  same  stability 
type  and  approximately  the  same  region  of  attraction. 

To  apply  this  to  the  simulation  example  recall  that 
r(t)  =  A  cost  with  .4  =  0.1.  Hence, 

U(0)  =  j[A  -  a(0)\  (12) 

where  a(0)  is  defined  for  constant  0  by 

a(0)  =  2avg{x(-,0)cos(  •)}  (13) 

Thus,  a(0 )  is  essentially  a  Fourier  series  coefficient  corre¬ 
sponding  to  the  1-periodic  component  of  the  frozen  pa¬ 
rameter  solution  x(t,0). 

To  determine  a(0),  consider  the  case  where  x{t,0)  is 
well  approximated  by  the  pure  harmonic 

x(t.O)  —  a(0)  cos  t  +  b(0)  sin  t. 


Substituting  into  (8),  equating  coefficients  of  cost, sin/, 
and  neglecting  higher  harmonics  gives: 


0A  =  kb  —  (1  —  — c2)a 
0  =  ka  +  (\  —  —  c~)b 


These  formulae  can  be  found  in  many  texts,  e.g.  ,  [pg. 
29,  Hayashi(1964)].  A  more  useful  form  in  our  case  is 
to  parametrize  a,b,6  in  terms  of  c,  the  magnitude  of  the 
harmonic  response.  Thus, 


a  =  -c(l-tc2)/yP+(l-fc^ 

6  =  kc/yjk*  +  (1  -  f^2)2 
0  =  +  -  fc=)2 

Substitution  into  (12)  gives. 


/a  A0) 


A 

2 


o(l 


h3) 


^  +  (1  _  |C2)2< 


(14) 


(15) 


Recall  that  the  adaptive  algorithm  is  designed  to  approx¬ 
imately  minimize 


V{0)  =  avg  {(r  -  x)2} 


Using  (14),  we  also  have 


V(0)  = 


1 

2 


+ 


2ca(l-3c2)  \ 

+  0  - 


(16) 


(17) 


Figure  4(a)-(b)  shows  plots  of  (7 /av.^A)  vs.  c  on  dif¬ 
ferent  scales.  The  equilibrium  of  the  averaged  system,  6, 
satisfies  /av(0)  =  0.  The  expanded  scale  in  Figure  4(b)  re¬ 
veals  that  (0,c)  =  (.5878,  1.157).  These  predicted  values 
are  in  close  agreement  with  the  simulation  results,  :.e.  , 
from  Figure  3(k),  (0,  c)slm  %  (  577,  1.25).  Note  that  7 /av 
is  identical  to  dO/dt  in  the  averaged  system  (9).  Values 
from  the  simulation  are  in  general  agreement  with  the 
predicted  values  in  Figure  4: 


Csim 

2.30 

1.76 

1.45 

1.18 

$sim 

-.0032 

-.0036 

-.0031 

.0000 

7  /i» 

-  .0056 

-.0038 

-.0032 

.0000 

Figure  4(c)  reveals  that  the  equilibrium  of  the  averaged 
system  is  stable  because  dfav/d0  is  strictly  negative  (al¬ 
though  small)  at  the  equilibrium.  For  comparison  to  the 
optimum,  Figure  4(d)  shows  a  plot  of  V  vs.  6.  Observe 
that  V(0)  =  .66  whereas  the  optimum,  which  occurs  at 
0opt  =  1.9,  gives  V(dopt)  =  -62.  Hence,  the  equilibrium 
of  the  averaged  system  is  close  to  the  optimum,  which 
implies  that  the  simple  gradient  adaptation  rule  is  well 
approximating  the  true  gradient. 


Figure  1  also  reveals  that  the  equilibrium  has  a  large 
region  of  attraction,  namely,  for  c  €  [1.1, 2.4]  or  equiva¬ 
lently  0  G  [  55,80].  One  can  not  immediately  conclude 
that  tin*  adaptive  system  inherits  this  region  of  attrac¬ 
tion  because  we  have  only  examined  the  averaged  sys¬ 
tem  corresponding  to  an  almost  pure  harmonic  solution 
(11)  Super-  and  sub-harmonic  responses  would  in  prin¬ 
cipal  have  to  also  be  evaluated,  and  such  formulae  ex¬ 
ist.  eg.  ,  [Hayashi(  1964)].  However,  the  spectral  plots 
in  Figures  3(a)-(k)  show  that  in  most  instances  the  har- 
m<  me  response  tends  to  dominate.  This  lends  credence 
t<  >  *  lie  conjecture  that  the  adaptive  system  has  a  region 
of  attraction  which  is  well  approximated  by  the  region  of 
ait;  action  of  the  averaged  system  corresponding  to  the 
harmonic  frozen  parameter  system  solution  (14).  Again, 
comparison  of  predicted  values  with  the  simulation  data 
plants  in  Figure  4(a)  tend  to  support  this  claim.  The 
spectra!  plots  also  show  that  the  chaotic  behavior  can  be 
vieua-d  to  some  extent  as  "noise"  corrupting  the  harmonic 


5  Concluding  Remarks 

I  la-  simulation  results  are  encouraging  and  support  the 
use  of  a  simply  constructed  adaptive  control  to  minimize 
the  potentially  deleterious  effects  of  uncertain  unmodeled 
non  linearities.  The  method  of  averaging  is  shown  to  pro¬ 
vide  a  good  qualitative  prediction  of  the  system  behavior 
despite  the  presence  of  chaotic  and  multi-  periodic  phe¬ 
nomena. 
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Abstract 

An  important  aspect  of  system  identification  is  the 
problem  of  experiment  design.  This  paper  uses  a  fractional 
representation  approach  to  state  and  solve  the  closed-loop 
experiment  design  problem  in  terms  of  variables  which  are 
at  the  designer’s  disposal:  the  closed-loop  inputs  and  the 
initial  controller.  Results  of  computer  simulations  are  pre¬ 
sented  which  compare  optimal  versus  several  non-optimal 
identification  experiments 


Introduction 

The  problem  of  system  identification  is  to  estimate  the  unknown 
parameters  of  a  dynamical  system  or  plant  from  measurements  of 
systems  input  and  output  as  shown  in  Figure  la.  In  the  figure,  u 
is  the  measurable  system  input,  y  is  the  measurable  system  out¬ 
put  and  to  is  an  unmeasurable  system  noise.  Experiment  design  is 
the  problem  of  choosing  the  experimental  conditions  ( e.g .  input 
signal  u  or  sample  time)  to  optimize  the  results  of  an  identifica¬ 
tion  experiment.  In  the  case  of  open-loop  operation,  this  is  a  well 
studied  problem,  see  (1, 2j  and  references  therein.  Unfortunately, 
most  actual  identification  experiments  are  conducted  while  the 
system  is  operating  under  closed-loop  control  (Figure  lb)  and 
directly  applying  existing  open-loop  results  to  the  closed-loop 
problem  generally  gives  unsatisfactory  results.  Open-loop  tech¬ 
niques  can  take  into  account  t he  loop  induced  v-w  correlation 
only  at  the  expense  of  greatly  increased  complexity  and  gener¬ 
ally  yields  a  result  in  terms  of  the  plant  input  u,  a  variable  which 
is  not  at  the  designer’s  disposal.  In  this  paper,  the  fractional 
representation  [d,  1,  f)j  will  be  used  to  avoid  the  problem  of  the 

‘Supported  by  the  Department  of  Energy  Contract  DR  AC04-7CDP0G789 
f Supported  by  NSF  Grant  ECS  85-12041 

iSupported  by  AFOSR  Contract  F49620-89-O-0013DEF  and  NSF  Grant 
ECS- 8  6- 0.0646 


(i*) 


Figure  1:  Ulock  diagrams  of  open-loop  and  closed-loop  system 
identification  problems. 


plant  input  and  noise  correlation  and  to  obtain  solutions  directly 
in  terms  of  the  loop  inputs  and  the  initial  controller,  variables 
which  arc  potentially  at  the  designer’s  disposal. 

We  assume  that  during  the  identification  experiment  the  plant 
is  in  stable  closed-loop  control  and  that  the  initial  stabilizing  con¬ 
troller  (Co  in  Figure  lb)  is  fixed  and  known.  As  an  experiment 
design  objective  we  use  that  proposed  in  [6],  It  assumes  that  the 
estimated  plant  will  be  used  to  design  a  new  controller  and  at¬ 
tempts  to  minimize  errors  in  the  closed-loop  dynamics  due  to  the 
new  controller  being  designed  for  the  estimated  plant  rather  than 
the  true  plant.  Wc  present  the  optimal  closed-loop  input  spectra 
which  minimizes  this  objective  subject  to  power  constraints  on 
the  loop  inputs,  the  plant  input  and/or  the  plant  output.  To  our 
knowledge,  this  is  the  first  time  the  closed-loop  experiment  de¬ 
sign  problem  has  been  solved  directly  in  terms  of  the  loop  inputs. 
We  also  derive  the  optimal  initial  controller  (for  use  during  the 
identification  experiment)  for  the  case  of  the  a  constraint  on  the 
power  in  the  plant  input  and  output.  This  result  is  a  generaliza¬ 
tion  of  the  results  in  (7). 


(R,  S)  Parameterization 


The  results  presented  in  this  paper  are  derived  by  means  of  the 
fractional  representation  (3,  4,  5].  This  theory  represents  both 
the  plant  and  compensator  as  the  ratio  of  stable  coprime  factors 
and  has  been  used  extensively  in  compensator  design,  for  example 
[5,8], 

Let  I'o  be  a  noise  free  plant  and  Co  be  any  initial  compensator 
which  stabilizes  P0.  Express  I’o  as  Nq/Dq  where  Nq  and  Do 
are  stable  and  coprime  (share  no  unstable  zeros)  and  similarly 
express  Co  as  the  ratio  of  the  stable  coprimc  factors  Xo/Yq-  Then 
all  compensators  which  stabilize  P  can  be  shown  (3,  4,5]  to  be 
of  the  form 

CQ  Yo-QN0'  () 


where  Q  is  stable.  Conversely,  Cq,  for  any  stable  Q,  will  stabilize 
P. 


By  duality,  all  noise  free  plants  which  are  stabilized  by  a  given 
compensator  can  be  similarly  parameterized  in  terms  of  a  stable 
parameter,  say  It,  sec  [9].  In  (10,  11]  it  is  further  shown  that  the 
noise  dynamics  of  all  plants  stabilized  by  a  given  compensator  can 
also  be  parameterized,  by  a  stable,  stably  invertible  parameter, 
S.  These  results  arc  restated  below. 

The  standard  plant  representation  for  identification  is 


V  :  y  =  Gu  +  II w .  (2) 

where  u,  y  and  w  arc  the  plant  input,  output  and  noise  respec¬ 
tively.  G  and  II  are  the  plant  inpul/output  and  noise  dynamics 
respectively.  Assuming  that  V  is  stabitizablc,  then,  without  loss 
of  generality,  P  can  also  be  represented  as 

V  :  Dy  =  Nu  +  Mw. 


(3) 


where  N/ D  is  a  coprime  factorization  of  G%  and  M  is  both  stable 
and  stably  invertible.  Define  the  triplet  (D,  N,M)  to  be  the 
coprime  factorization  of  the  plant  V.  Then,  it  can  be  shown 
[  1 1  ]  that  a  given  plant  V  with  coprime  factorization  (Dt  N ,M)  is 
stabilized  by  the  compensator  Co  if  and  only  if  it  can  be  expressed 
as 

p(fi,s) :  v  -  (4) 


Aro  +  RYq  _  N  /c\ 

G/i  =  D0  =  D  •  (5) 

„  _  s  _  M  ffiv 

D0  -  RX0  D' 

11  is  stable,  S  is  stable  and  stably  invertible,  and  Xo,  Vo,  A'o,  and 
Do  are  as  defined  previously.  The  parameters  11  and  5  are  easily 
shown  to  be 

n  =  M-NoD.  (V) 

A'0 N  +  Y0D  v  ' 

X  o  A'o  +  Vo  Dy 

5  =  A'o  A'  +  Y0D  A/  ■  (8) 

Figure  2  shows  a  block  diagram  representation  of  V(R  s)- 

Note  that  the  parameters  (R,S)  form  a  subsystem  within  the 
plant:  p  -  Ra  +  Sw.  It  is  the  properties  of  this  ( R,S )  sys¬ 
tem  which  simplifies  the  closed-loop  experiment  design  problem. 
These  properties  include: 

1.  It  and  5  are  the  oidy  unknowns  in  the  plant/loop.  The 
identification  problem  can  be  restated  in  terms  of  estimat¬ 
ing  ( R,S )  rather  than  ( C ,  //). 

2.  The  (R,S)  system  operates  in  open-loop.  The  gain  from  P 
to  o  is  necessarily  zero. 

3.  The  input  of  the  ( R,S )  system  is  ct  =  Xofi  +  Yor2  and 
is  thus  dependent  only  on  the  closed-loop  inputs  and  the 
compensator.  In  particular,  o  is  independent  of  both  the 
true  plant  and  the  plant  noise. 


? 

Vc  u 


Plant,  V 


Figure  2:  Closed-loop  block  diagram  showing  the  unknown  plant 
as  a  bridge  centered  on  the  ( R,S )  system. 

These  properties  arc  easily  verified  using  (4),  (5),  (6).  Taken 
together,  these  properties  allow  the  identification  problem  to  be 
restated  as  one  of  estimating  ( R,S )  from  a  and  p  rather  than 
estimating  (G,H)  from  u  and  y,  thus  transforming  the  closed- 
loop  problem  in  an  open-loop  problem.  In  addition,  property  3 
indicates  that  a  is  dependent  only  on  the  closed-loop  inputs  and 
the  initial  compensator,  <|uantitios  which  arc  at  the  experiment 
designer’s  disposal.  Therefore,  any  experiment  design  results  for 
the  ( R,S )  system  which  gives  specifications  on  o  will  also  solve 
the  closed-loop  experiment  design  problem. 


Experiment  Design  Problem 

As  an  experiment  design  objective,  we  use  one  suggested  in  (<jj 
which  is  oriented  specifically  toward  identification  for  the  pur¬ 
poses  of  controller  design.  Assuming  the  estimated  plant  is  used 
to  design  a  new  controller,  this  objective  seeks  to  minimize  errors 
in  the  closed-loop  dynamics  due  to  the  fact  that  the  controller 
was  designed  for  the  estimated  plant  rather  than  the  true  plant. 

We  make  the  following  assumptions  concerning  the  plant  iden¬ 
tification  experiment. 

1.  The  true  plant,  Pt,  is  known  to  be  a  member  of  some  known 
set  n.  This  set  is  such  that  there  exists  a  robust  controller 
which  stabilizes  all  plants  in  II. 

2.  During  the  identification  experiment,  the  plant  is  controlled 
by  a  fixed  initial  stabilizing  controller,  Co,  which  stabilizes 
all  plants  in  II.  Co  is  assumed  known. 

3.  After  the  identification  experiment,  the  estimated  plant, 
V,  is  used  to  design  a  new  controller  by  some  pre  defined 
design  rule  C  =  V(P). 

The  objective  to  be  minimized  is  defined  as 


=  f  I  a  rv 


where  £w  is  the  expectation  operator  witii  respect  to  the  plant 
noise,  Wt  is  a  frequency-dependent  weighting  function,  and  A 7^, 
is  the  error  in  the  closed-loop  transfer  function  from  to  y  (see 
Figure  2)  as  a  result  of  C  being  designed  for  V  rather  than  Vt. 
Thus 

G.C  GC 

A 7V,  =  - - r— r  .  (10 

’  1+G,C  1+CC 

where  G,  and  G  are  the  I/O  dynamics  of  the  true  and  estimated 
plants  respectively  ami 

We  use  a  general  power  constraint  on  the  signal  a: 


where  <t0  is  the  power  spectral  density  of  q  and  Wa  is  a  frequency- 
dependent  weighting  function. 

Unfortunately,  this  objective-constraint  pair  cannot  be  solved 
directly.  We  therefore  approximate  the  objective  following  the 
procedure  described  by  Ljung  in  [2,  12].  First  let  C(  =  V{Pt)  be 
the  controller  designed  for  the  true  plant.  Let  X( /Vj,  (D,,  Nt,  M,) 
and  ( D,N,M )  be  coprime  factorizations  of  Cj,  Vt  and  V  respec¬ 
tively.  Finally,  let  (Ri,St)  and  ( R,S )  be  the  ( R,S )  parameteriza- 
tions  of  Pi  and  V.  Assuming  that  the  plant  estimate  V  is  “dose” 
to  the  true  plant  Vt  (in  the  sense  that  A R  =  R,  —  R  is  small) 
and  the  design  rule  V  is  continuous,  then  it  is  shown  in  [11]  that 
lATyrJ7  can  be  approximated  to  first  order  in  |A/1|  by 

|A7V,|J=  W„|Aft|7  (11) 

where 

wH  = _ _ 7  (12J 

H  (XTN,+YtD,y(XoNo  +  Y0D0)  v  1 

Thus,  the  J/  is  approximately 


Ljung  shows  in  (2]  that  £„,|A/i|3  can  be  approximated  asymptot¬ 
ically  for  large  n,  large  N  and  small  n/N  by 

03) 


where  n  is  the  order  of  the  plant  model  in  the  identification  algo¬ 
rithm,  A  is  the  number  of  data  points  used  in  the  identification 
and  <&„,  and  are  power  spectral  densities  of  w  and  a  (12].  This 
approximation  assumes  that  identification  algorithm  is  a  PEM 
(Prediction  Error  Method)  type,  that  the  (RitSi)  system  is  in 
open-loop  and  that  the  true  model  is  in  the  model  set  (i.e.  no 
unmodeled  dynamics). 

Collecting  everything  except  <J>0  into  a  single  objective  weight¬ 
ing  function,  the  final  design  problem  becomes: 


with  respect  to  •to  and  possibly  Co  subject  to  the  constraint 

J  ‘$‘aW0(u)duJ  <  K  (15) 

where 

Wobj  =  (1G) 

Solutions  to  this  design  problem  are  discussed  in  the  following 
section. 

Optimal  Designs 

We  consider  two  different  design  problems.  In  one,  the  initial  con¬ 
troller  is  assumed  fixed  and  we  obtain  the  set  of  optimal  closed- 
loop  input  signals.  In  the  other,  we  find  both  the  optimal  initial 
controller  and  the  closed-loop  input  signals.  We  first  consider  the 
constraint  in  more  detail. 


|  Constraint 

Wo 

J 

f  i’r^Vr^  <  1( 

—  jr 

l*o’l 

J 

^  <tr^Wr^cLj  <  K 

—  jr 

inr'fw'r. 

Total  input  power 

|(max{A'0,Vo})”1| 

J 

r  bvwy,<kj  <  k 

—  w 

N, 

N,Xo  +  DcY0 

2 

w 

J 

<J>UrWu,du;  <  A' 

—  X 

Dt 

NtX0  +  D,Y0 

2 

wy. 

Table  1:  Several  possible  constraints  which  can  bo  put  in  the 
form  (15)  and  the  corresponding  IV0. 

Loop  Input  Design 

The  problem  of  minimizing  (14)  with  respect  to  "to  subject  to 
(15)  is  a  standard  minimization  problem  which  admits  a  closed 
form  solution  [2].  The  solution  is 

4W  =  7  (20) 

where  7  is  a  scaling  constant  chosen  so  that  equality  is  obtained 
in  the  constraint.  The  optimal  spectra  for  the  closed-loop  inputs 
rq  and  r2  must  therefore  be  such  that 


The  C  onstraint 

Often  the  loop  inputs  represent  physical  quantities  which  need  to 
be  constrained  during  the  identification  experiment.  A  constraint 
on  a  does  not  directly  yield  a  constraint  on  rq  and  r2  since  the 
inverse  map  from  o  to  r  1  arid  r2  is  not  unique.  However,  if  the 
power  apportionment  between  rq  and  r2  is  determined  a  priori 
then  (15)  immediately  becomes  a  constraint  on  the  loop  inputs. 

For  example,  suppose  that  the  loop  is  to  be  driven  from  rq 
only.  Then,  0  =  .Yon  (with  r2  =  0),  and  a  general  power  con¬ 
straint  on  r j  of  the  form 

J  “t,.,  Wri  (u)dxj  <  K 

is  accomplished  via  (15)  by  using  the  weighting  function 

U'o^IVlV,,.  (17) 

Likewise,  if  only  r2  is  to  be  used  to  drive  the  loop,  the  appropriate 
choice  of  IV0  in  (15)  is 

H'fl  =  |  Vrj.  (18) 

Also,  a  constraint  on  the  total  power  in  the  loop  inputs  is  accom¬ 
plished  by  setting 

Wo  =  |(max{AoH,ToH})-,|2  .  (19) 

where  it  has  been  assumed  that  each  input  (iq  or  r2)  will  be  used 
only  at  those  frequencies  where  it  has  the  highest  gain  to  the 
internal  signal  o.  These  weighting  functions  is  listed  in  Table  1. 

It  is  also  common  for  the  loop  inputs  to  be  non-physical  num¬ 
bers  somewhere  inside  a  feedback  control  program.  In  this  case 
constraining  the  loop  inputs  has  little  meaning  and  it  makes  more 
sense  to  constrain  the  input  and  output  of  the  plant  itself.  De¬ 
note  that  portion  of  u  and  y  which  is  due  only  to  the  loop  inputs 
as  ur  and  y,,  Then,  by  the  proper  choice  of  Wa,  (15)  can  also 
be  used  to  constrain  the  power  in  u,  and  y,.  See  [11]  for  details. 
These  weighting  function  arc  also  listed  in  Table  1. 


^o.opi  —  |Ao|  'b r  1  .opt  +  Dol  ^rj.opt  ■  (21) 

Thus,  the  optimal  closed-loop  inputs  arc  characterized  not  by 
a  single  pair  of  spectra  for  r,  and  r2,  but  rather  by  the  set  of 
non-negative  definite  solutions  to  (21).  This  solution  set  can 
be  shown  [11]  to  be  independent  of  the  particular  choice  of  the 
nominal  plant  Vo,  and  coprime  factorizations  for  Vo  (Ao/Do),  for 
V,  (Dt,  A„  Mt),  for  C,  (X,/Y,)  and  for  C0  ( X0/Y0 ). 

The  solution  given  by  (20)  and  (21)  has  the  disadvantage  that 
it  depends  on  the  true  plant  through  Wob j  and,  in  some  cases, 
Wa.  Though  this  problem  is  shared  by  most  other  experiment 
design  solutions  in  the  literature,  it  severely  limits  the  solution’s 
practical  utility.  To  address  this,  we  propose  to  restate  the  origi¬ 
nal  design  problem  in  terms  of  an  average  over  all  possible  plants. 
The  plant  lias  been  assumed  a  member  of  a  known  set  II.  We 
further  assume  that  the  true  plant  is  a  random  variable  with  a 
known  distribution  within  that  set.  The  averaged  design  problem 
can  then  be  stated  as: 


subject  to  the  average  constraint 

fp,  J  $0W0dw  <  h' ,  (23) 

where  €p,  is  the  expectation  operator  over  all  possible  true  plants. 
Doth  expectations  arc  assumed  finite.  Therefore  the  expectation 
and  integration  operator  can  be  exchanged  and  the  solution  is 
easily  shown  to  be 

4W-.vc  =  7  W) 

In  the  rest  of  the  paper,  this  spectrum  will  be  referred  to  as  the 
“optimal  averaged  spectrum".  Note  that  this  is  not  simply  the 
result  of  averaging  the  optimal  spectrum  over  II. 


Controller  Design 

The  previous  section  considered  the  problem  of  finding  the  opti¬ 
mal  closed-loop  input  signals  given  a  fixed  initial  controller.  In 
this  section  we  will  consider  the  problem  of  finding  both  the  op¬ 
timal  closed  input  signal  and  the  optimal  initial  controller.  The 
special  case  considered  is  that  of  the  design  constraint  being  of 
“LQG-type”  on  the  power  of  the  plant  input  and  output.  In 
particular  we  will 

Minimize  Ji  =  f  ,ubj  du  (25) 

«/—  »  ***  a 

with  respect  to  both  Co  and  $0,  subject  to  the  constraint 

I"  (a2d>u  +  624>y)<hj  <  K  .  (26) 


First  note  that  since  the  loop  is  linear,  the  constraint  can  be 
restated  as 

J\aH\,+b24>y.ykj<I<-J\a2*u„W<']lJd-j=  Kr .  (27) 

where  Kr  is  defined  as  shown.  As  in  before.  uT  is  that  compo¬ 
nent  of  u  due  entirely  to  tiic  closed  loop  inputs  and  uw  is  that 
component  of  u  due  to  the  plant  noise  w,  likewise  with  yr  and 
yw.  From  Tabic  1,  this  can  be  expressed  in  the  form  of  (15)  with 


tri/J>,|2  +  62lA',|2 

lA'o/V,  +  VbAP 


(28) 


From  the  previous  section,  the  optimal  <J>a  for  a  given  Co  is 


This  result  contains,  as  special  cases,  two  previously  pub¬ 
lished  results  by  Ljung  and  others  (2,  6,  7]  on  optimal  controllers 
for  closed-loop  identification  and  shows  them  to  be  the  extremes 
in  a  continuum  of  such  design  problems.  In  [2,  6)  the  authors 
show  that  if  the  constraint  is  placed  on  u  alone  then  open- loop 
operation  is  optimal  for  plant  identification,  assuming  that  the 
plant  is  stable.  By  a  similar  analysis  it  is  shown  in  [7)  that  a 
plant  output  constraint  implies  a  minimum  variance  controller 
is  optimal,  assuming  that  the  plant  is  minimum  phase.  Both  of 
these  results  are  special  cases  of  the  solution  presented  here.  If 
a  =  1  and  6  =  0,  the  constraint  is  on  u  and  minimizing  J|,qh 
yields  the  “high  cost  of  control”  solution  (open-loop  operation 
when  V  is  stable).  If  a  =  0  and  6  =  l.llic  constraint  is  on  y 
and  the  optimal  Co  is  the  “cheap  control”  solution,  (the  mini¬ 
mum  variance  controller  when  P  is  minimum  phase).  However, 
the  solution  presented  here  is  valid  if  the  plant  is  unstable  or 
non-minimum  phase  and  for  the  continuum  of  values  of  a  and  6 
between  these  two  extremes. 

The  original  constraint  (26)  specifies  a  maximum  on  the  total 
power  of  u  and  y.  The  LQG  controller,  merely  seeks  to  minimize 
the  noise  contribution  toward  this  maximum  leaving  as  much 
power  as  possible  for  the  “signal”  contribution  of  o.  Thus  this 
solution  can  be  interpreted  as  using  that  Co  which  maximizes 
the  signal-to-noise  ratio  in  the  signals  u  and  y  This  solution 
also  lias  the  implication  that  the  initial  controller  is  important 
only  in  the  case  where  the  constraint  is  small  enough  that  the 
plant  noise  makes  a  significant  contribution  to  A'. 


Simulations 


^o.ojalCo 


(29) 


where  7  is  chosen  such  that  the  equality  is  achieved  in  the  con¬ 
straint.  Thus  7  is 

(30) 

which  implies  that  the  minimum  Ji  for  any  given  Co  is 

nn 

-'J.mmlCo  ~  - ^ -  •  VJ11 

Minimizing  this  with  respect  to  Co  will  yield  the  optimal  initial 
compensator  for  the  identification  experiment.  Using  (16),  (12) 
and  (28),  Wa  becomes 


To  illustrate  this  experiment  design  technique  we  offer  the  fol¬ 
lowing  simulation  examples.  In  these  simulations,  the  plant  is 
stabilized  by  an  initial  fixed  controller  and  is  identified  from  500 
input-output  data  samples.  The  final  estimated  plant  is  used  lo 
design  a  new  compensator.  The  resulting  closed-loop  transfer 
functions  are  calculated  for  the  loops  containing  the  new  com¬ 
pensator  and  the  true  plant  Tp,,  and  the  new  compensator  and 
the  estimated  plant,  Tp.  Finally,  the  simulated  experimental  ob¬ 
jective  is  obtained  by  averaging  the  integral  squared  difference 
between  Tp ,  and  Tp  over  100  independent  simulations.  Note 
that  this  is  the  original  objective  (9),  not  the  approximation. 

The  set  of  plants  we  consider  was  first  suggested  in  (13)  as 
a  benchmark  problem  for  system  identification,  adaptive  control 
and  robust  control.  The  continuous  time  model  is 

,  =  777^777;)  ■  (33> 


WobjH'o  =  ^u,Wr(aJ|D,|2  +  62|yv,|2) 


(X,Nt  +  YD,)2 


The  important  point  is  that  this  product  is  independent  of  the 
initial  compensator  Co-  Thus,  the  only  term  in  the  cost  J/,nun|Co 
which  is  a  function  of  Co  is  Kr  and  J/,njn|c0  will  achieve  a  min¬ 
imum  when  K,  achieves  its  maximum.  I\r  is  maximized  when 

Aqg  =  f  (a24>u„  +  624>v„  )<L>  (32) 


is  minimized  (sec  (27))  which  is  the  precisely  the  LQG  prob¬ 
lem.  Therefore,  the  optimal  controller  to  use  during  the  during 
the  identification  experiment  when  the  design  constraint  is  of 
“LQG-type”  is  the  associated  LQG  controller.  The  optimal  loop 
input  spectrum  is  given  by  (29).  Note  that  this  result  is  inde¬ 
pendent  of  the  weighting  function  in  the  objective,  Wp,  or  the 
new-compensator  design  rule  V. 


The  unknown  parameters  in  the  system  are  wri  the  natu.al  fre¬ 
quency,  and  the  damping  ratio,  and  arc  assumed  to  be  in  the 
intervals, 

1  Hz  <  Wr/ 2*  <  2  Hz 

.02  <  (  <  .1 


(34) 


These  uncertainties  comprise  the  set  n.  When  necessary  wc  as¬ 
sume  u>r  and  (  arc  uniformly  distributed.  We  simulated  two 
particular  plants  in  this  set;  P,  witli  ( wr,( )  =  ( 1  Hz, 0. 1 )  and 
Pjwilh  (u>r,{)  =  (2Hz,0.02). 

This  plant  was  transformed  into  a  discrete  plant  assuming  a 
zero-order-hold  and  a  sampling  rate  of  20  Hz.  No  noise  model  was 
included  [13].  Wc  assume  the  full  plant  dynamics  (input/output 
and  noise)  arc  of  the  form: 


P  :  ( 1  +  aiz-1  +  ajz-2  +  aaz-3  +  = 

(6|*  1  +  6jz  2  +  6jz-3  +  6<z-<)u  +  1 


(35) 


whore  w  is  white  Gaussian  noise.  All  eight  coefficients  are  esti¬ 
mated.  The  initial  controller  is 

_  1  -  2.G 9;-'  +  2.532~2  -  .84  U~3 

0  _  1  -  .7252- 1  -  .175;-2  -  ,00925z-3  ‘  (  ' 

which  stabilizes  all  plants  within  the  uncerta!  ‘y  (34).  With  this 
controller  the  closed-loop  has  essentially  the  same  resonance  as 
the  plant.  This  resonance  will  have  a  noticeable  impact  on  the 
final  experiment  designs. 


Figure  3:  Filial  control  system  in  S  I  R  configuration 


The  estimated  plant  is  used  to  design  a  new  controller  in  the 
configuration  shown  in  Figure  3.  Letting  <jr  be  the  estimated 
plant's  nati  d  frequency,  A  and  11  are  chosen  so  that: 

a)  the  resonant  poles  are  radially  projected  inwards  by  a  factor 
of  .95  (the  “control”  poles)  and  .85  (the  “estimator”  poles), 
and 


b)  the  double  integrator  poles  arc  moved  to  a  natural  fre¬ 
quency  of  (.3  +  ,3uir )  with  a  damping  ratio  of  .85  (“control” 
poles)  and  a  natural  frequency  of  (1  +  wr)  with  a  damping 
ratio  of  .9  (“estimator”  poles). 

E  is  then  selected  so  that  the  four  selectable  closed-loop  ze¬ 
ros  coincide  with  the  “estimator"  poles  specified  above.  This 
choice  make  the  overall  control  design  equivalent  to  a  statc- 
estimator/stale-variable-fecdback  controller.  This  particular  de¬ 
pendence  on  tii,  was  chosen  to  obtain  a  faster  closed-loop  with 
the  faster  plants  (those  with  higher  resonant  frequencies). 

Experiments  are  designed  to  minimize 

Jl  -  f  |A7'yr,ptfwi. 


This  new  controller  is  slightly  more  general  than  that  considered 
earlier  due  to  the  presence  of  the  pre-compensator.  I3y  similar 
arguments  this  objective  can  be  approximated  by 


W, 


obj 


<lu , 


where  Wobj  is 


WAi  =  ^A|5,|2 


/fi/t<(Ao/V(  +  YoD,)2 

'  E,2 

(B,N,  +  AtDtf(X0N0lrY0D0) 

D, 

(37) 


and  At,  B,,  and  E<  comprise  the  new  compensator  designed  for 
the  true  plant.  All  other  notation  is  consistent  with  that  used  in 
Section  2  with  Bt  and  A,  corresponding  to  Xt  and  Yt  respectively. 

The  first  set  of  results  we  present  arc  for  the  case  where  a 
power  constrain'  is  placed  on  the  loop  input  rj.  Note  that  this 
constraint  is  one  which  can  not  be  addressed  by  previously  pub¬ 
lished  experiment  design  techniques.  Figure  4  shows  the  four 
input  spectra  used  in  the  simulations.  It  includes  the  optimal 


Figure  4:  Optimal  r2  spectra  assuming  the  true  plant  to  be  V\ 
and  Vi,  the  averaged  optimal  spectrum  and  a  white  spectrum. 
Optimal  spectra  calculated  for  a  power  constraint  on  r3. 


spectra  assuming  the  true  plant  to  be  V\  and  Vi,  the  opLitna]  av¬ 
eraged  spectrum  and  a  white  spectrum,  all  of  unity  power.  Note 
how  the  optimal  spectrum  for  Vi  notches  out  the  plant’s  reso¬ 
nant  frequency.  Recall  that  when  Co  is  used,  the  plant  and  loop 
have  the  same  resonance.  Therefore,  if  Vi  is  the  true  plant,  the 
gain  from  r3  to  both  u  and  y  will  be  large  at  2  Hz;  little  power 
is  required  at  that  frequency  to  excite  the  plant,  thus  the  notch. 


logfMeun  squared  value  of  r2) 


Figure  5:  Simulation  results  obtained  when  true  plant  is  V\  and 
loop  is  driven  by  spectra  shown  in  Figure  4. 


logfMeon  squared  value  of  r2) 

Figure  6:  Simulation  results  obtained  when  true  plant  is  Vi  and 
loop  is  driven  by  spectra  shown  in  Figure  4. 

Two  parallel  sets  of  simulators  were  run,  one  with  the  true 
plant  being  V\  and  the  other  with  Vj.  Figures  5  and  6  show  the 
average  experimental  objective  versus  input  power  at  r3  for  each 
of  the  four  spectra  in  Figure  4.  In  each  simulation  the  plant  was 
also  driven  by  a  white  noise  at  tn  of  power  A  =  10"”. 

In  both  sets  of  simulations,  the  optimal  spectra  for  the  true 
plant  provides  the  best  plant  identification,  a  factor  of  3  belter 
than  a  white  input  is  V\  is  the  true  plant  and  a  factor  2  better  if 
Vi  is  the  true  plant.  Note  also  that  if  Vi  is  the  true  plant,  using  a 


s j > * *t  l r u in  ilt'si^ncd  to  7'|  is  worst1  than  simply  a  white  loop  input. 
However,  the  optimal  averaged  input  provides  a  superior  plant 
idoitUhcalio'i  than  either  a  white  input  or  an  input  designed  for 
the  “wrong”  plant  and  nearly  as  good  an  identification  as  the 
optimal  input  spectrum. 

In  a  final  set  of  simulations  we  tested  the  optimal  initial  con¬ 
troller  result  presented  earlier.  In  this  example  we  choose  the 
const  faint  to  he 

J  (.5'I>U  +  ,5'bil)duj  <  l< 

for  some  K  The  optimal  initial  controller  is  the  LQG  controller 
designed  to  minimize  the  control  cost 

£  (.5'lv  +  .54>, ,„)</<-■ 

where  and  yw  are  those  portions  of  u  and  t/,  respectively,  due 
to  tin*  plant  noise  alone.  To  test  this  result,  we  performed  sim¬ 
ulate.!  identification  experiments  using  five  different  LQG  con¬ 
trol!*'!'  designed  to  minimize  the  control  cost 

j  -Ml  -  />)' 1* 

for  p  -  0.93,0.0,0.5,1). I  ;mil  0.01,  each  assuming  the  V2  was  the 
true  plant.  As  a  sixth  alternative,  experiments  were  also  s'mu- 
lat.-.i  using  tlu-  initial  robust  controller  presented  earlier  in  this 
f  ction.  For  the  purposes  of  this  example  the  LQG  controllers 
will  be  referred  to  as  C'o.p  and  the  robust  controller  will  be  do- 
noted  C0  ,,, i,. 


-10  1  2  3  4 

log(  (MS  value  of  u  +  MS  value  of  y)/2  ) 


f  igure  7:  Simulation  for  the  initial  controllers  Go, .99  through 
Co,  01  and  Co.n.le  In  all  simulations  the  true  plant  is  p2- 

Figure  7  shows  the  results  of  simulations  using  each  of  these 
six  initial  controllers.  In  all  cases,  V2  was  the  true  plant.  As 
before,  each  data  point  is  the  average  of  100  independent  simu¬ 
lations.  These  simulations  confirm  that  Co,  5  is  the  best  initial 
controller,  providing  the  lowest  average  objective  over  4  orders 
of  magnitude  in  both  the  constraint  and  the  objective.  Just  as 
importantly,  these  results  confirm  that  the  initial  controller  is  im¬ 
portant  only  if  the  constraint  is  sufficiently  small  that  the  plant 
noise  is  a  significant  component  of  the  plant  input  and  output. 

Conclusion 

'I  lie  problem  of  system  identification  experiment  design  in  which 
the  system  In  le  1  '■  i.  ' 1  is  ope  rating  i  n  a  at  aide  closed  ’-'op  has 
been  addressed.  We  have  shown  how  to  minimize  the  objective 


proposed  by  Yuan  and  Ljung  [Gj  subject  to  power  constraints  on 
the  closed-loop  inputs,  the  plant  input  and/or  the  plant  output. 
In  addition  to  being  more  general  than  other  solutions,  our  solu 
tion  has  the  unique  feature  that  it  yields  specifications  on  vari¬ 
ables  which  arc  at  the  designer’s  disposal,  i.e.  the  closed-loop 
inputs  and  the  initial  compensator  used  during  the  experiment. 
Previous  solutions  yield  specifications  on  the  plant  input,  a  vari¬ 
able  which  not  at  the  designer’s  disposal.  The  solution  for  the 
optimal  initial  compensator  contains  two  previously  published 
results  as  special  cases  and  shows  them  to  be  the  extremes  of  a 
continuum  of  such  solutions.  Wc  also  presented  simulation  re¬ 
sults  which  demonstrate  the  use  of  our  method. 

In  this  paper,  we  have  not  addressed  the  important  problem  of 
unmodcled  dynamics.  However,  wc  believe  that  this  method  of¬ 
fers  advantages  here  as  well.  For  example,  the  weighting  function 
Wp  can  be  selected  to  de-cmpliasizc  those  frequencies  were  the 
unmodcled  dynamics  are  dominate.  Furthermore,  the  fact  that 
the  (/f,S)  system  is  necessarily  stable  simplifies  the  techniques 
for  on-line  uncertainty  estimation  in  [Mj  and  broadens  the  tech¬ 
niques  in  (15,  1GJ  to  be  applicable  to  any  system  operating  in  a 
stable  closed-loop. 

References 

(1]  11.  K.  Mchra.  Choice  of  input  signals.  In  Trends  and  Ptogixst  in  System 
Identification.  Pergamon  Press,  Klm&ford,  New  York,  1981. 

(2]  L.  Ljung.  System  Identification,  Theory  jor  the  User.  Prentice- Hall, 
1987. 

(3]  D.  C.  Youla,  J.  J.  Bongiorno,  and  H.  A.  Jabr.  Modern  Wiener* Hopf 
design  of  optimal  controllers,  part  i:  The  single-input  case.  Ill  EE  Irons, 
on  Auto.  Control,  AC-2!:3-l4,  Feb  1970. 

(4]  C.  A.  Desoer,  R.  W.  Liu,  J.  Murray,  and  R.  Sacks.  Feedback  system  de- 
sigu:  The  fractional  representation  approach  to  analysis  and  synthesis. 
IEEE  Trans.  Auto.  Control,  AC-25:399-412,  June  1980. 

(5]  M.  Vidyasagar.  Contivl  System  Synthesis:  A  Factorization  Approach. 
MIT  Press,  Cambridge  Mass,  1985. 

(G)  Z.  Yuan  and  L.  Ljung.  Unprejudiced  optimal  open  loop  design  for  iden¬ 
tification  of  transfer  functions.  Aufornalica,  21(6):697-70K,  1985. 

(7]  M.  Gcvers  and  L.  Ljung.  Benefits  of  feedback  in  experiment  design.  In 
7,v  l FAC  Symposium  on  Identification  and  System  Parameter  Estima¬ 
tion,  pages  909-914,  York,  UK,  July  1985.  IFAC/1FORS. 

(8]  S.  P.  Doyd,  V.  Baiakrishnan,  C.  II.  Barratl,  N.  M.  Kraishi,  X.  Li,  D.  G. 
Meyer,  and  S.  A.  Norman.  A  new  CAD  method  and  associated  ar¬ 
chitectures  for  linear  controllers  IEEE  Trans,  on  Auto.  Control,  AC- 
33(3):268-283,  1988. 

(9]  Q.  Haung  and  R.  W.  Liu.  A  necessary  and  sufficient  condition  for 
stability  of  a  perturbed  system.  IEEE  Trans.  Aulo.  Control,  AC-32:337- 
340,  April  1987. 

[10]  F.  Hansen  and  G.  Franklin.  On  a  fractional  representation  approach  to 
closed-loop  experiment  design.  In  Proc.  Joint  Automatic  Control  ConJ., 
pages  1319-1320,  Atlanta,  Ga,  June  1988. 

[11]  F.  Hansen.  A  Fractional  Ileprescntation  Approach  to  Closed-loop  System 
Identification  and  Experiment  Design.  PhD  thesis,  Stanford  University, 
Stanford,  CA,  March  1989. 

[12]  L.  Ljung.  Asymptotic  variance  expressions  for  identified  black-box  trans¬ 
fer  function  models.  IEEE  Trans  on  Auto.  Control,  AC-30(9):834-844, 
Sep  1985. 

{l 3]  C.  R.  Johnson,  A.  Foss,  G.  Franklin,  R.  Monopoli,  and  G.  Stein.  Toward 
development  of  a  practical  benchmark  example  for  adaptive  control. 
Control  Systems  Magazine,  l(4):25-28,  Dec  1981. 

(14]  R  Kosut.  Adaptive  control  via  parameter  set  estimation.  Int.  Journal 
of  Adaptive  Control  and  Signal  Processing,  2:371-399,  1989. 

[15]  B.  Walberg.  On  model  reduction  in  system  identification.  In  Proceeding 
of  the  1986  American  Control  Conference,  pages  12G0-126G,  Seattle, 
Wa,  June  1986. 

(IG]  R  O.  LaMairc,  L.  Lalavani,  M.  Alhans,  and  G.  Sticn.  A  frequency 
estimator  for  use  in  adaptive  control  systems.  In  Proceedings  0}  the  IUS7 
American  Control  Conference,  page’s  238-241,  Minneapolis,  Minn.,  June 
1987. 


